Operator/circuit interface with integrated display screen

ABSTRACT

Operator interaction with electrical systems is facilitated by providing electromechanical control devices, which have switch buttons, rotary knobs or the like, with flat panel displays that convey information pertaining to the controls that can be changed instantly by a display controller. The display may identify the function of the control, the current setting, create calibration marks or provide other graphics. The images change automatically if the same control is used for multiple functions. In one form of the invention, the display screen has openings in the image area and the controls extend through and protrude from the screen enabling display of graphics in close proximity to the controls. In another form, the settings of controls which are secured to the face of a display screen are optically or magnetically detected by sensors located behind the screen. In still another form of the invention, the display is embedded in a switch key and has an image area that is substantially coextensive with the key. This enables permanent markings, such as are found on computer keyboard keys for example, to be replaced with changeable images that identify multiple functions of the keys.

CROSS REFERENCE TO RELATED APPLICATIONS

This is a division of my allowed application Ser. No. 08/420,438 filedApr. 10, 1995 (now U.S. Pat. No. 5,572,239) which is a continuation ofmy application Ser. No. 08/225,782 filed Apr. 11, 1994 and which is nowabandoned. Application Ser. No. 08/225,782 was a continuation-in-part ofmy application Ser. No. 08/147,545 which was filed on Nov. 5, 1993 nowabandoned.

TECHNICAL FIELD

This invention relates to apparatus for enabling operator interactionwith electrical systems and more particularly to apparatus of this kindwhich includes a display screen that visually conveys information to anoperator or user of the apparatus.

BACKGROUND OF THE INVENTION

Operators of certain types of electrical apparatus manipulate adifferent switch button, key, rotary knob or the like to control eachdifferent function of the apparatus. Traditional controls of this kindare convenient to operate and provide fast response to operator input.As such controls are single function devices, identifying labels,settings location symbols, calibration marks and other graphics arepermanent markings situated adjacent to or on the controls.

Increasingly, electromechanical controls of the single function kind arebeing replaced with multiple function controls in which the operatoruses a single device to initiate or control a number of differentoperations. Visual symbols or other graphics that may be needed by theoperator in order to utilize the control are presented on a displayscreen which is situated in the vicinity of the control. The graphicscan be changed instantly to enable use of the same control for differentpurposes. A control of this kind can replace a large number ofspecialized single function controls and can in fact have virtuallyunlimited functional flexibility. The keyboard keys, mouse or trackballand video display screen which interface a computer and the user of thecomputer are an example of multiple function controls of this kind.

Prior multiple function controls of the above described kind havedisadvantages that are not experienced by operators of traditionalsingle function controls although this has not been widely recognized.Prior multiple function controls require more complex and prolonged handmovements on the part of the operator and are less comfortable tooperate at least for most users.

While the present invention is not limited to use with computers,consideration of the current interfacing of a computer and the operatoris illustrative of problems which are inherent in prior multiplefunction controls.

Much of the operator input to a computer is effected with a mouse ortrackball and the computer screen. The following sequence of handmanipulations is required to select a single "pop up" window on acomputer screen and then make a selection within that window:

(a) The hand is moved to grasp the mouse or trackball.

(b) Additional hand movement travels the screen cursor to a selectedspot on the screen.

(c) Finger movement at the mouse or trackball switch clicks the deviceto select that specific spot.

(d) Further hand movement travels the cursor to a new spot on the screenwithin the pop up window.

(e) Further finger movement at the mouse or trackball makes theselection from the window.

Clearly it would be faster and less taxing to just turn a knob and/orpush a switch to make such selections. Complex software, such as fourcolor graphics and picture generation or music sound design andsequencer software, forces the operator to make hundreds or thousands of"clicks and drags" of the mouse or trackball in order to run a singleprogram.

Pushing a switch or turning a knob feels right because it is familiar,it works fast and it satisfies the human mind's natural sensoryperceptions. Thus it would be advantageous if multiple function controlsgave the operator the immediate response and familiar tactile feel oftraditional single function control mechanisms.

Prior efforts to accomplish this have significant limitations. Switchbuttons have been positioned adjacent to the perimeters of liquidcrystal displays or cathode ray tube screens. The display or screen isthen used to create temporary labels which identify the current functionof each switch. The visible image areas of the displays or screens aresmaller than the total areas of the faces of the devices owing to thepresence of thick structural framing, seals and/or bus conductors at theperipheral regions of the devices. Consequently, labels which appear onthe screen are located a distance away from the switches which thelabels identify. Typically, the label is 5/8 of an inch to 3/4 of aninch away from the switch. This makes it less easy to identify aparticular label with a particular switch and increases the possibilityof operator error. It is also not possible to situate graphics, such asradial lines or other control setting indicators, at any location aroundthe periphery of a control as is often desirable.

Touch screens, utilizing infrared beams or the like, of the type used ascontrol panels for industrial computer screens or in kiosks in stores,malls, banks or hotels, for example, can also be configured as multiplefunction controls but also have undesirable characteristics. Theresponse time of touch screens is slow at best. It is often necessary totouch the screen two or three times to enter instructions or data. Thefeel of a touch screen is not a satisfactory tactile experience for manyoperators.

The present invention is directed to overcoming one or more of theproblems discussed above.

SUMMARY OF THE INVENTION

In one aspect of the present invention, operator and electrical circuitinterfacing apparatus has at least one circuit component which enablesoperator interaction with the circuit and has an electrically controlleddisplay screen. Control means generate any of a plurality of differentimages at an image display area of the screen. At least a portion of thecircuit component is situated at the screen within the image displayarea. The control means generates an image on the screen that conveysinformation pertaining to the operation of the circuit component.

In another aspect of the invention, the control means generates theimage at a location on the screen that is adjacent to the circuitcomponent.

In another aspect of the invention, the control means enables display ofdifferent information pertaining to the component at different times atthe same location adjacent to the component.

In another aspect of the invention, at least one opening extends intothe image display area of the screen and at least a portion of thecircuit component is situated within the opening. The circuit componenthas a control member which can be moved from a first position to atleast one other position to alter an electrical characteristic of thecomponent which control member extends outward from the screen.

In another aspect of the invention, sensor means detect movement of thecontrol member and the sensor means may be behind the screen.

In another aspect of the invention, apparatus for enabling manualcontrol of electrical equipment has a plurality of operator actuatedcomponents each having a component housing and an actuator which extendsfrom the the housing and which can be moved from a first position to atleast one other position to alter operation of the equipment. Theapparatus further includes a control panel formed at least in part by aflat panel display having an image area at which visible images can bedisplayed. A plurality of spaced apart openings extend into the displayat locations which are within the image area. The component housings aresituated behind the image area and the actuators of the componentsextend through the openings in the image area. Control means generatevisible images at the image area at locations which are in proximity tothe actuators which images convey information pertaining to operation ofthe components.

In another aspect of the invention, an electromechanical switch has amovable switch cap which may be depressed by an operator to operate theswitch. The switch further includes a flat panel display with a displayscreen having an image area at which visible images may be generated,the flat panel display being embedded in the switch cap. Control meansenable display of an image on the screen which conveys informationpertaining to use of the switch. The image area of the screen issubstantially coextensive with the end surface of the cap.

In another aspect, the invention provides a radio of the kind having aplurality of station selector switches each having a button which may bedepressed to select a particular station. Each of the buttons has a flatpanel display screen forming at least a portion of the front surface ofthe button. Display control means cause each of the screens tochangeable indicia that identify the station that is selected bydepression of the particular button.

In a further aspect of the invention, a keyboard for connection to dataprocessing apparatus has a plurality of keys which may be selectivelydepressed to initiate different operations within the data processingapparatus. The keys include at least one multiple function key which isusable to initiate any of a plurality of different operations within thedata processing apparatus. A flat panel display is embedded in themultiple function key for displaying different images which identify thedifferent functions of the key. Display control means cause the flatpanel display to display a first of the images when the multiplefunction key is to be used to initiate a first of the operations andcauses the flat panel display to display a second of the images when themultiple function key is to be used to initiate a second of theoperations.

In still a further aspect, the invention provides operator andelectrical circuit interfacing apparatus having a push button switchwith a switch cap which is depressed to operate the switch and having aflat panel display screen and control means for generating an image onthe screen that conveys information pertaining to the switch. The switchhousing is secured to the screen at a location which is at leastpartially within the image display area of the screen. The switch cap isengaged with the housing and thereby. A resilient element in saidhousing resists depression of the switch cap. A radiant energygenerating device is disposed behind the screen in position to directradiant energy along a path which extends through the screen and intothe switch housing and switch cap. A translatable member in the switchcap has a radiant energy reflective surface, the member being movablebetween a first position at which the reflective surface is withdrawnfrom the radiant energy path and a second position at which thereflective surface is situated in the radiant energy path, The switchfurther includes means for shifting the member from one of its positionsto the other thereof in response to depression of the switch cap and forreturning the member to the original position in response to release ofthe switch cap. A radiant energy detector is disposed behind the screenin position to detect radiant energy which is reflected by thereflective surface.

The invention enables use of familiar electromechanical control devicessuch as keys, switch buttons, rotary knobs and the like in contextswhere symbols, markings or other graphics need to be present in closeproximity to the devices and need to be instantly changed to accommodateto different operations or stages of operation. Manipulation oftraditional controls of this kind is uncomplicated, can be effectedquickly and is appealing to the operator from the tactile or sensorystandpoint. In one form of the invention, the control devices extendthrough openings within the image area of one or more electricallycontrolled display screens which provide the changeable graphics. Inanother form of the invention, movements and/or settings of controlactuators that are secured to the face of a flat panel display aredetected by optical or magnetic sensors which may be located behind thescreen. In still another form of the invention, the changeable graphicsare presented at a display screen which forms the end surface of aswitch button, keyboard key or other similar control device. Singly orin groups, the functionally flexible controls may be used in conjunctionwith diverse types of electrical apparatus of which computer terminals,appliance control panels and MIDI keyboard controllers are among manyother examples.

The invention, together with further aspects and advantages thereof, maybe further understood by reference to the following description of thepreferred embodiments and by reference to the accompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a frontal view of a portion of a control panel or consolehaving a series of different manually operated devices for controllingelectrical systems or for inputing data to such systems.

FIG. 2 is a section view taken along line 2--2 of FIG. 1.

FIG. 3 is another frontal view of the control console that is generallysimilar to FIG. 1 except that the console is now displaying differentgraphics.

FIG. 4 is an enlarged view of the portion of FIG. 2 encircled by dashedline 4 in FIG. 2.

FIG. 5 is an enlarged view of the portion of FIG. 2 encircled by dashedline 5 in FIG. 2.

FIG. 6 is an exploded perpective view of a corner region of a flatdisplay panel component of the apparatus of the preceding figures.

FIG. 7 is diagrammatic depiction of bus bar routing within the displaypanel of FIG. 6.

FIG. 8 is a diagrammatic depiction of an alternate form of bus barrouting within the display panel.

FIG. 9 is a frontal view of another control panel having another form ofmanually operated control which undergoes sliding movement.

FIG. 10 is a partial cross section view of the apparatus of FIG. 9 takenalong line 10--10 thereof.

FIG. 11 is a partial section view of the apparatus of FIG. 9 taken alongline 11--11 thereof.

FIGS. 11A and 11B depict opposite faces of the screen of a flat paneldisplay illustrating another construction for routing bus bar conductorswhen an opening is present in the screen.

FIG. 12 is a frontal view of still another control panel having banks ofkey operated switches suitable for operating complex digital systems andwhich includes a modular array of display panels.

FIG. 13 is a frontal view of a switch box having a switch key with afirst display panel embedded in a second and larger display panel.

FIG. 14 is a cross section view taken along line 14--14 of FIG. 13.

FIG. 15 is a section view of a key operated switch having a flat paneldisplay embedded in the key cap.

FIG. 16 is a frontal view of still another control console embodying theinvention which can be used for window selection and item selection at acomputer terminal without requiring manipulation of a mouse ortrackball.

FIG. 17A depicts a computer system having a keyboard with graphics oncertain multiple function keys that change when the functions of thekeys change.

FIG. 17B is another depiction of the computer system of FIG. 17A showingan example of changed graphics at the multiple function keys of thekeyboard.

FIGS. 18A, 18B and 18C are frontal views of an automobile radioembodying the invention and illustrating changing graphics which aredisplayed under different conditions of operation.

FIG. 19 is a schematic circuit diagram of the radio of FIGS. 18A, 18Band 18C.

FIG. 20 is a perspective view of an integrated control switch and flatpanel display in accordance with another embodiment of the invention.

FIG. 21 is a broken side view of another integrated control switch andflat panel display embodying the invention in which settings of theswitch are optically sensed by components behind the display screen.

FIG. 22 is an exploded perspective view of switch housing and switch capcomponents of the embodiment of FIG. 21.

FIGS. 23 and 24 depict certain components shown in FIG. 22 in greaterdetail.

FIGS. 25 and 26 depict modified forms of certain components of theembodiment of FIG. 21.

FIG. 27 is a broken out view illustrating a modification of theembodiment of FIG. 21.

FIG. 28 is a broken out side view of a portion of still anotherintegrated control switch and flat panel display in which settings ofthe switch are magnetically sensed by components behind the displayscreen.

FIG. 29 is a top view of the embodiment of FIG. 28.

FIG. 30 is a section view of still another embodiment of the inventionin which depression of a switch cap is optically sensed by componentsbehind the flat panel display screen.

FIG. 31 is in part a top view of the apparatus of FIG. 30 and in part asection view taken along line 31--31 thereof.

FIG. 32 is a section view corresponding to FIG. 30 showing the switch inits actuated condition.

FIG. 33 depicts the configuration of a latching pin track within theembodiment of FIGS. 30 to 32.

FIG. 34 is a broken out side view of a modification of the embodiment ofFIGS. 30 to 33.

FIG. 35 is a broken out top view of the apparatus of FIG. 34.

FIG. 36 is a top view of a top view of another embodiment in which acontrol member is slidable along the screen of a flat panel display andin which the movement is detected by components behind the screen.

FIG. 37 is a cross section view of the apparatus of FIG. 36 taken alongline 37--37 thereof.

FIG. 38 is a section view taken along line 38--38 of FIG. 36.

FIG. 39 is a foreshortened top view of a modification of the apparatusof FIGS. 36 to 38.

FIG. 40 is a foreshortened section view taken along line 40--40 of FIG.39.

FIG. 41 is a section view illustrating a modification of the embodimentof FIGS. 39 and 40 in which movement of the control member is sensed bymagnetic means rather than optical means.

FIG. 42 is a foreshortened section view of another modification of theembodiment of FIGS. 39 and 40 in which movement of the control member issensed by electromechanical means which extends through the displayscreen.

FIG. 43 is a foreshortened top view of the apparatus of FIG. 42.

FIG. 44 is a section view taken along line 44--44 of FIG. 43.

FIG. 45 is a section view taken along line 45--45 of FIG. 43.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

The invention is adaptable to single devices for enabling operatorinteraction with electrical apparatus and also to control panels orconsoles having a plurality of electromechanical controls or data inputdevices. For purposes of example, FIGS. 1 and 2 depict a portion of acontrol panel 11 which supports four such devices 12, 13, 14 and 16. Inthis embodiment, device 12 is a switch of the type having an axiallytranslatable shaft 17 that protrudes from a switch housing 18 and whichis operated by manually depressing a switch cap or button 19 on the endof the shaft. Device 13 is a functionally similar switch having ahousing 21, shaft 22 and depressible cap 23. Device 14 is a rotaryencoder of the type having a housing 24, a protruding shaft 26 and acontrol knob 27 at the end of the shaft. Encoder 13 produces a multi-bitdigital signal encoding a value which may be selected by the operator byturning control knob 27. Device 16 is a potentiometer of the type whichproduces a voltage having a magnitude that is selectable by turning aknob 28 situated at the end of a shaft 29 that protrudes from thepotentiometer housing 31.

Devices 12, 13, 14 and 16 may be of conventional construction except aswill hereinafter be described. Terminals 32 at the housing of each suchdevice enable connection of the device to an electrical circuit for anyof the purposes that such devices are customarily used. The switches 12,13, encoder 14 and potentiometer 16 are illustrative of the types ofelectromechanical control device to which the invention is applicableand it should be recognized that the invention is also applicable toother forms of electromechanical control device.

Control devices, such as switches 12, 13, encoder 14 and potentiometer16, usually have visible graphics in the vicinity of and/or on thedevice. Such graphics may be words, letters, numbers, icons or othermarkings and variously serve to identify the function of the device,identify the different settings of the device, convey instructions orwarnings or serve other purposes. Such graphics have traditionally beenproduced by printing, engraving, silk screening or other methods whichcreate graphics that are permanent and which cannot be quickly changed.

The present invention enables instant changing of graphics 33 when acontrol device 12, 13, 14 or 16 is to be used for more than one functionor where such changing is desirable for other purposes such as in thedisplaying of new setups. The invention further enables placement ofchangeable graphics 33 immediately adjacent to or in very closeproximity to the device 12, 13, 14 or 16 to which the graphics relate.For this purpose, the devices 12, 13, 14 and 16 are integrated with anelectrically controlled flat panel display 34 of the type which has ascreen 36 at which changeable visible images are produced.

In this embodiment of the invention, the devices 12, 13, 14 and 16extend through openings 37 in the screen 36. The actuators, such asswitch cap 19 and rotary knobs 27 and 28, are situated directly in frontof the screen 36 or, as in the case of switch cap 23, protrude from thescreen. The housings 18, 21, 24 and 31 of devices 12, 13, 14 and 16 arebehind the screen 36.

Screen 36 in this particular example of the invention is a liquidcrystal display but may also be of any of the other known types of flatpanel display that generate changeable images in response to signalsreceived from a display controller 38 through a multi-conductor bus 39.The controller 38 may be of any of the known designs and in many casesis an internal component of a computer. Changing of the graphics 33 asdepicted in FIG. 3 may variously be initiated by programming, byactuation of another device such as a code key on a keyboard (not shown)or in response to operation of the control device 12, 13, 14 or 16 withwhich the graphics are associated. The screen 36 may be eithermonochrome or one which produces multi-colored images.

Referring again to FIGS. 1 and 2, further components of the flat paneldisplay 34 include an integrated circuit driver board 41 which receivesthe signals from the controller 38 and which may be of known circuitconfiguration. Driver board 41 is disposed behind screen 36 in spacedapart, parallel relationship with the screen. The housings 18, 21, 24and 31 of the control devices 12, 13, 14 and 16 of this example aresecured to driver board 41 and conductors 42 extend through the board toenable connections to be made to the terminals 32 of the devices.

Backlighting of the screen 36 is provided for by a backlight panel 43disposed between the screen and driver board 41 in spaced apartrelationship with each such component. The light panel 43 in thisembodiment is a flat rectangular array of light emitting diodes 44energized though conductors 46 which extend to the driver board 41.Other known light sources may be used, such as fiber optic cloth,fluorescent light tubes, incandescent or halogen light bulbs or thelike. No backlighting is required if the screen 36 is of theelectroluminescent type.

In this embodiment of the invention, the space between screen 36 andlight panel 43 is filled with hardened plastic 47, such as epoxy forexample, which adheres to the screen and which provides solid supportand backing to the screen thereby preventing damage from externalforces. At least a portion of the plastic 47 that is between light panel43 and screen 36 is of the translucent type and serves as a lightdiffuser which distributes light evenly between the different areas ofthe screen. Alternately, plastic 47 may be clear epoxy or the like if athin layer of light diffusing material is adhered to the screen 36.

Plastic framing 45 extends between the peripheral regions of driverboard 41 and light panel 43 and components of the flat panel display 34are unitized by screws 50 which extend through the driver board andlight panel and engage in the body of plastic 47 which is situatedbetween the board and screen 36.

Some types of display screen 36 are composed wholly of solid materiallike PDLC and thus the openings 37 can simply be drilled or stampedwithout concern about leakage although sealing of the material aroundthe periphery of each opening may still be desirable to prevent infusionof moisture or other contaminants. Other types of display screen 36,such as the liquid crystal display screen of this example, contain athin layer of liquid or semi-liquid material 51. Referring now to FIG.4, the screen 36 includes two slightly spaced apart, parallel thinplates 48 and 49 formed of transparent plastic or glass and the liquidcrystal material 51 is contained between the plates. The liquid crystal51 may be of any of the known types such as polymer dispersed liquidcrystal, cholesteric and the like. In other embodiments of theinvention, the screen may be of the reflective or direct view type whichdoes not require backlighting.

Leakage of the material 51 at the perimeter of the screen 36 isprevented by an outer edge seal 52 which may be a band of epoxy plasticor the like that extends around the perimeter of the screen between theedges of plates 48 and 49. Referring to FIG. 5, similar bands of epoxyor the like extend around the openings 37 in screen 36, between adjacentedges of plates 48 and 49 and thus form internal edge seals 53.

In some applications of the invention, it is preferable or in some casesnecessary that the edge seals 52 and/or 53 be very thin as the areas ofthe screen 36 at which the seals are located are unusable for thepurpose of displaying images. Referring jointly to FIGS. 1 to 5, verythin outer edge seals 52 enable the usable image area of the 36 to besubstantially coextensive with the outline of the flat panel display 34as a whole. This maximizes the space available for changeable graphics.It also enables disposition of two or more of the flat panel displays 34in side by side and/or end to end relationship to form what appears tobe a single continuous display screen in a manner which will hereinafterbe described in more detail.

Very narrow internal edge seals 53 are appropriate in instances, such asat control device 13, where the component 23 that extends from thesurface of the screen 36 has transverse dimensions that are slightlyless than the transverse dimensions of the screen opening 37 throughwhich the component extends. Very narrow internal edge seals 53 enablegraphics to be displayed in very close proximity to the component suchas switch cap 23. Referring to FIG. 2, this result can be achieved withwider edge seals 53 in instances, such as at potentiometer knob 28,where the knob, switch cap or the like is sizably larger than theunderlying screen opening 37 and overlaps a sizable portion of thescreen around the perimeter of the opening.

Current technology enables formation of edge seals having widths rangingdown to about 0.005 inch.

Referring to FIG. 6, this particular example of the invention uses ascreen 36 having a bus bar structure of the type used in multiplexedliquid crystal displays. Images are produced at the screen 36 byapplying an electrical field across the liquid crystal material 51 orthe like at appropriate points or image pixels as dictated by theconfiguration of the image that is to be produced. To apply the field, afirst series of parallel bus bar conductors 54 extend across the surfaceof the outer screen plate 48 that faces liquid crystal 51. A second setof such conductors 56 extend across the surface of the inner screenplate 49 that faces the liquid crystal 51, conductors 56 being inorthogonal relationship with conductors 54. Thus, as is understood inthe art, an electrical field may be applied across any particular pointor pixel within the image area by applying a voltage difference to theparticular conductor 54 and the particular conductor 56 that cross eachother at the location of the particular point. Conductors 54 and 56 arepreferably formed of a transparent conductive material such as indiumtin oxide.

In flat panel displays of the active matrix type both sets of bus barconductors are located at the same side of the electro-optically activematerial with thin film insulation being situated between the X and Ybus bars. It should be understood that active matrix displays of thistype may be used in the practice of the present invention.

In most prior flat panel displays, electrical connections to the bus barconductors extend along the margins of the screen and cause a sizablemarginal region of the screen to be unusable for image display purposes.Screen constructions of that kind are suitable for some applications ofthe present invention while in others the image area should becoextensive with the screen. In instances where the image area is toextend substantially to the edges of the screen as described above, thebus bar conductors can extend to the edges of the plates 48 and 49 andthen be angled to run transversely across the edge of the plate as shownat 54a and 56a in FIG. 6. Thin, flat connectors 57, which are preferablyformed of flexible insulative material, have edges abutted against theedges of plates 48 and 49 and have spaced apart conductors 58 whichcontact the bus bar conductors 54a and 56a to create permanent lowresistance connections. Connectors 57 extend to driver board 41 as shownin FIG. 2 to interconnect the bus bar conductors and driver boardthrough permanent low resistance connections.

For clarity of illustration, connectors 57 are depicted in FIGS. 1 and 2with a greater thickness than is necessarily required. Using photolithictechniques, such connectors can be fabricated with thicknesses rangingdown to 0.001 inch.

Referring to FIG. 7, the presence of openings 37 in the image area ofscreen 36 would create a discontinuity in one or more of the bus barconductors such as conductors 54 unless arrangements are made tomaintain continuity. If the conductors 54 are addressed, i.e. receivetheir voltages, at one end only then the openings 37 would create blankregions in the image area between the openings and the far edges of thescreen 36. This can be avoided by addressing the conductors 54 at bothends. It is still preferable to provide a continuous conductive pathbetween the ends of each conductor 54. Otherwise, the presence of anon-conductive flaw at some point along the conductor causes a possiblylengthy segment of the conductor, located between the flaw and theopening 37, to be unenergized. This degrades image quality much moreseverely than if only the pixel at the site of the flaw is blanked out.

FIG. 7 depicts one technique for maintaining continuity of theconductors 54 which are directed towards an opening 37. In particular,the conductors 54 are curved or angled to extend along the portions ofplate 48 that are immediately adjacent to the opening 37 and to resumetheir original alignments at the opposite side of the opening.

The area of the screen 36 at which the conductors 54 are routed aroundthe margin of an opening 37 is unusable for image depiction. To minimizethe size of this area, the spacing of the conductors 54 may be reducedat such areas and if necessary the width of the conductors may bereduced at those areas. In practice, the number of conductors 54 is muchgreater than can be clearly depicted in FIG. 7 and conductor spacing ismuch smaller than can be depicted. If, for example, there are 100conductors per inch of plate 48 surface and opening 37 has a diameter ofone inch, then 100 conductors must be routed around the opening. Usingknown photolithographic techniques, the spacing of the conductors asthey pass around opening 37 can be reduced to 5 microns. The unusablearea of the screen adjacent opening 37 is then only about 0.5millimeters wide. Thus the unusable area does not have any significanteffect with regard to locating graphics in close proximity to theopening 37.

FIG. 8, which is a view of the underside of plate 48 of FIG. 6, depictsanother technique for maintaining electrical continuity of theconductors 54. Each conductor 54 which is directed towards an opening 37is angled to extend through the opening at the wall thereof as indicatedat 54b. The conductor is then routed around the opening 37 at theopposite surface of plate 48 as indicated at 54c. At the opposite sideof opening 37, the conductor extends back through the opening asindicated at 54d and then resumes its original course as indicated at54e. Spacing and width of the portions 54c of the conductors that are atthe opposite surface of plate 48 are not usually of particular concernas these portions of the conductors are away from the liquid crystal anddo not interfere with image display.

The conductors 54 are preferably made of a transparent material such asindium tin oxide.

Referring again to FIGS. 1 and 2, components other thanelectromechanical control devices can also be embedded in the screen 36such as, for example, a light emitting diode 61 may be embedded atanother sealed opening 37 to indicate that a device is on or off or forother purposes. Similar light emitting diodes 62 may be embedded in theswitch caps, knobs or the like of control devices 12, 13, 14, 16 such asis shown at switch cap 19 of switch 12. For this purpose, the shaft 17to which the switch cap 19 is secured may be hollow. This enables thelead wires 63 to extend through the screen 36 for connection to driverboard 41 or some other component.

Switch buttons or caps 19 of the type which are moved in the directionof the screen 36 during operation preferably have an annular cushion 64of resilient foam rubber or the like disposed between the switch cap andthe screen. In the case of switch caps 23 that extend into the screen36, a conforming recess 66 may be provided in the underlying translucentmaterial 47 to receive the cap and another resilient cushion 67 may bedisposed between the cap and the base of the recess.

FIGS. 9 and 10 and 11 depict another control system 11f having a seriesof faders 69 of the type used to vary sound volume in digital or analogsystems 71 of the known type which synthesize or otherwise process musicor other sound. Each fader 69, which may be of known construction, hasan elongated housing 72 from which a translatable shaft 73 extends atright angles to the housing. Shaft 73 carries an end cap 74 which ismanipulated by the operator to slide the cap and shaft along housing 72in in order to select a sound amplitude or to vary the amplitude. Ascale 76 of spaced apart lines is situated adjacent the path of travelof cap 74 and is usually calibrated in terms of decibels.

Control system 11f includes a flat panel display 34f that may be similarto the previously described panel display of FIGS. 1 to 8 except asherein described. Thus, with reference again to FIGS. 9, 10 and 11, theface of control system 11f is defined by a screen 36f of the flat paneldisplay 34f. Display 34f further includes a diode back-light panel 43f,driver board 41f with connectors 57f which extend to the edges of thescreen, and a filling 47f of translucent epoxy or the like which servesas a light diffuser, such components being arranged and interconnectedin the manner previously described. Fader housings 72 are disposedwithin panel display 34f between the back-light panel 43f and driverboard 41f. The translatable shaft 73 of each fader 69 extends through athin elongated slot 77 in screen 36f and back-light panel 43f andprotrudes from the face of the screen.

The internal edges of the screen 36f that bound the slot openings 77have narrow edge seals 53f of the previously described kind. Bus barconnectors 54f and 56f that are directed towards the slot 37f are madeelectrically continuous as has also been previously described. Routingof the bus bar conductors 54f around the slot 77 in the manner shown inFIG. 7 may in some instances create an undesirably wide zone at whichgraphics cannot be displayed owing to the large number of suchconductors that are intercepted by the lengthy slot. In such cases, thebus bar conductor 54f interconnections may be made through thin,multi-conductor, flexible connectors 78 which extend down from each sideof the slot 77 and around the fader housing 72 as shown in FIG. 11. Thetwo connectors 78 are permanently heat seal bonded together belowhousing 72 to maintain coherent bus bar continuity. The other set of busbars 56f, which intercept the narrow ends of slot 77, may be routedalong the edges of the adjacent plate 49f in the manner which has beenpreviously described.

If the bus bar conductors 54f are routed around the slot 77 in themanner previously described with reference to FIG. 8, rather than byusing the flexible connectors 78, the conductors have differing lengthsand thus different electrical resistances. This may detract from picturequality in instances where there is a large variation in the resistancesof the conductors. This may be counteracted in the manner depicted inFIGS. 11A and 11B which show opposite faces of plate 49f. In particular,the portions 75 of conductors 54f which extend around slot 77 at theface of the plate 49f that is away from the liquid crystal material mayhave different widths and/or thicknesses which are dependent on thelength of the particular conductor portion 75 and which are selected toequalize the electrical resistances of the conductor portions. In thisexample, progressively longer ones of the conductor portions 75 haveprogressively greater widths.

Referring again to FIGS. 9, 10 and 11, the plates 48f and 49f of screen36f of this embodiment are formed of transparent plastic as glass can besusceptible to breakage when a long opening 77 extends into proximity toone or more edges of the screen.

The faders are coupled to a computer 80, which controls the soundprocesser 71, through an analog to digital signal converter 85 or adigitally controlled attenuator as found in a series ten recordingconsole. The computer 80 maybe operated with known recording consoleautomation software such as SSL, Neve or Series Ten with slightmodifications to enable the display controller 38f to address screen 36fand provide the desired graphics.

Embedding of faders 69 in the panel display 34f enables display ofchangeable graphics, such as scales 76, at locations adjacent the pathof travel of the slidable caps 74 as well as at other locations in theadjacent area. This can greatly enhance operation of digital or analogsound processors 71. The display controller 38f of the system mayinstantly change the scale 76 enabling use of a fader 69 to controldifferent ranges of sound amplitude. For instance, a scale 76 showingthe standard infinity to 0 dB to +6 dB or +10 dB may be changed to oneshowing 1/2 dB or 1/4 dB steps over a much smaller range, such as a 2 dBrange, for example. Computer 80 can be programmed to automaticallychange the fader scale 76 based upon how fast the operator moves the cap74. With fast movement, the scale may be the above described standardone. With slower motion, the resolution of the scale may be increasedthereby enabling extremely precise operator control of the fader 69.

Recording consoles commonly have light emitting diodes or the like whichindicate various conditions such as the overall automation mode andautomation update conditions, for example. These can be eliminated ifthe control system 11f has a full color screen 36f which can emulate thediodes by displaying LED simulations 81 on screen 36f which areaccompanied by displays 82 that identify the functions of the LEDsimulations. Computer 80 can be programmed to cause the simulations 81to strobe, pulsate, flicker or stay lit to indicate different automationstates and to enable the operator to change the size, shape, color andlocation of the simulations on screen 36f. Visual information 33f suchas labels, notes, icons, pictures, real time video and writtendescriptions and the like can also be presented on the screen

Referring to FIG. 12, a control system 11g having a bank of 32 buttonoperated switches 13g of the previously described kind embedded in adisplay screen 36g may control 32 digital tracks of direct-to-diskrecording for digital sequencing. By changing the labeling 83 of theswitches 13g at screen 36g, the same switches may be used to provide 32different cue storage points for locating positions within the recorder.

Control system 11g has a modular construction in which multiple flatpanel displays 34g of the hereinbefore described kind are disposed inside by side and end to end relationship which permits these separatescreens to appear as a continuous display screen 36g. This is madepossible by the previously described very thin seals at the edges of thescreens of each module and by the previously described thin connectorswhich energize the bus bar conductors at the edges of the screens. Useof the modular construction provides for a shorter addressing time thancan be realized with a large continuous screen. The seals and connectorscan be made sufficiently thin to maintain conformity of image pixelspacing across the boundary of adjacent panel displays 34g although thisis not essential in all instances. The panels may be spaced apart bydistances of approximately 10 to 20 mils, for example.

FIG. 16 depicts a control system 11h embodying the invention which maybe coupled to a computer 84 that includes a display control board. Thecontrol system 11h enables selection of pop up windows and selection ofitems within the windows without the use of a mouse or trackball.

Control system 11h has a button operated switch 13 and a rotary encoder14 of the previously described kinds which are embedded in a flat paneldisplay 34h in the manner which has also been previously described. Thescreen 36h of console 11h is of sufficient size to display computergenerated graphics 33h of the kind that are customarily displayed on avideo display terminal although it is preferable to rearrange thelocation of icons or the like to accommodate to the rotary movement ofthe encoder knob 27h. Display of the main menu is accompanied by displayof lines 86 extending from locations around the periphery of encoderknob 27h to the several icons in the menu enabling turning of the knobto select a pop up window. The encoder 14h can generate a differentdigital signal byte at each setting of the knob that enables thecomputer to recognize the icon which has been selected. Depression ofswitch 13h transmits a signal to the computer that is equivalent to theclicking of a mouse or trackball and thus results in the replacement ofthe main menu graphics 33h with the graphics of the selected pop upwindow. Encoder knob 27h may then be turned to select a particular itemfrom the window.

The console 11h may, if desired, have additional controls embedded inthe flat panel display 34h that perform other functions similar to thoseof conventional controls that are associated with a computer terminaland the display may be used to provide changeable graphics for suchcontrols.

Control devices which are embedded in a display screen to provide acontrol panel with changeable graphics may themselves be provided withan additional flat panel display. FIGS. 13 and 14 depict a switch 88 ofthe type having a depressable switch cap 89 at the end of an actuatorshaft 91 that extends from the switch housing 92. The switch cap 89 isitself a panel display 93 of the hereinbefore described type except thatthe light panel 94 may be adjacent the driver board 96 as there are nocontrol device components therebetween. The display screen 97 in theswitch cap is overlain with a protective transparent cover 98.

Switch cap 89 is disposed in front of the screen 102 of another andlarger flat panel display 101 that may also be similar to the previouslydescribed displays. The actuator shaft 91 to which cap 89 is securedprotrudes from screen 102 through an opening 99 which extends completelythrough the screen 102, diffuser 103, light panel 105 and driver board104 of the larger display 101 and the switch housing 92 is secured tothe floor of a casing 106 that supports the larger display. Cap 89 islarger than the cross sectional area of opening 99 and thus overlaps anarea of the larger display screen 102. The cap 89 is spaced from thescreen and a volume 90 of compressible foam rubber or the like issituated between the cap and the screen. Flexible multi-conductor cables107 in casing 106 enable control signals from the display controller 108to be transmitted to the driver boards of each display through separatepin connectors 109 at the wall of the casing 106. The cable 107 whichconnects with the driver board 96 of switch cap 89 is routed throughactuator shaft 91 which is of tubular construction. The switch terminals111 at housing 92 are connected to external terminals 112 on theexterior of casing 106 to enable connection of the switch with apparatuswhich the switch controls.

The switch cap panel display 93 may be used to display words, symbols,icons, real time video or the like that identify the function of theswitch 88 while the larger panel 101 displays other information that isuseful to the operator. Both displays may be instantly changed when theswitch 88 is used for different functions at different stages ofoperation of the controlled apparatus.

Use of extremely thin flexible connectors 113 to address bus barconductors at the edge surfaces of the switch cap screen 97 and use ofvery narrow edge seals as previously described enables the image area onthe cap to be substantially coextensive with the cap itself. Referringto FIG. 15, a similar switch construction 88a is highly useful incontexts where the panel 114 behind the the switch is not another flatpanel display that produces changeable images. Liquid crystal displayshave heretofore been embedded in switch caps but a sizable portion ofthe marginal region of the screens has been occupied by thick edge sealsand by bus bar connections. This has limited the available image area toone which is substantially smaller than the total area of switch capface. This is a particularly severe disadvantage in the case of smallswitch caps. The types of display that have heretofore been embedded inswitch caps would leave virtually no room for image display in a squarecap measuring one half inch along each side.

Switches 88a having a full size image area in the switch cap 89a can behighly useful in a variety of contexts. For example, with reference toFIG. 17A, such switches 88a may be used to replace the permanentlymarked keycaps of an alphanumeric computer keyboard 116 or the like.Many computer programs require use of so called "soft keys" on thekeyboard. Keys or combinations of keys are used for purposes other thantyping in the letter, number or other symbol that is imprinted on thekey. The operator must memorize which keys are involved in thesenon-typing functions. For example, a particular program may require thatthe "Z" key be pushed to initiate an "Undo" function as there is no keyon the standard keyboard that is expressly dedicated to that function.

Replacing the permanently engraved keycaps with caps 89 having embeddedlarge area display screens 97 enables the labelling of the keys to bechanged automatically to display whatever function a program is callingfor at a particular time. As shown in FIG. 17A, the caps 89 may displaythe standard alphanumeric characters at times when the computer 117 isconditioning the keyboard 116 for entry of alphanumeric data. As shownin FIG. 17B, the display at one or or more keys can be changedautomatically in response to selection of a menu on the master computerscreen 118. Luminosity of a key or group of keys can be changed to callattention to the key or keys.

In the example shown in FIGS. 17A and 17B, the particular keycaps 89which are used to enter certain standard commands in a computer of theMac System 7™ type are provided with embedded display screens for theabove described purpose and icon selection keys are also provided withchangeable displays. A display controller 119 generates the requiredgraphics at such keycaps 89. The computer 117 may operate in the knownmanner using the known operating system and programming.

Using the techniques hereinbefore described, further circuit componentscan be embedded in the switch cap panel display. FIG. 15 depictsembedding of a light emitting diode 121 in the switch cap 89a. For thispurpose, the actuator shaft 91 of the switch is hollow and extendsthrough the driver board 96, light panel 94, a layer 122 of translucentmaterial bonded to the back surface of the display screen 97 and thescreen itself through a conforming opening 123 in such components. Theend of the shaft 91 contacts the inside surface of the protectivetransparent cap cover 98. The edges of screen 97 which bound opening 123have thin seals 124 of the previously described kind. Bus bar conductors(not shown in FIG. 15) that extend towards opening 123 are madeelectrically continuous by one of the techniques which have beenpreviously described.

Light emitting diode 121 in this embodiment is situated within shaft 91at a location adjacent the transparent switch cap cover 98. In analternate construction, shaft 91 may extend through cover 98 and thediode 121 may protrude slightly from the outer surface of the cover toenhance visibility. Shaft 91 is preferably formed of opaque material sothat light from the diode 121 does not detract from the quality of theimages produced by screen 97. The thickness of the internal thin seals124 can be increased slightly from what would otherwise be necessary toprevent diode light from entering the adjacent portion of the image areaof the screen 97.

The light emitting diode 121 is energized through a two conductorelectrical cord 126 which extends within shaft 91 and then out throughthe wall of the shaft to connect with the circuit which controls thediode. In the present example, cord 126 connects diode 121 across theoutput terminals 111 of switch 88a in series with a current limitingresistor 127 and thus the diode provides a visual indication of closingand opening of the switch. The diode 121 may be energized in response toany of various other operating conditions in the apparatus to which theswitch 88a is connected by connecting cord 126 to other terminals in thecircuit.

The flat panel display controllers which are a component of the abovedescribed embodiments of the invention may be of the known designs. Suchcontrollers are available commercially along with instructions forprogramming desired graphics. As will be apparent from the foregoing,the graphics which are appropriate to different embodiments of theinvention may take diverse different forms. One example of suitablesoftware is presented at the end of this specification. This examplecauses alternating displays of the words "ON" and "OFF" adjacent aswitch cap in response to successive depressions of the switch cap andthus is usable with the control switch of electrical devices of the typewhich turn on in response to a first operation of the switch and thenturn off in response to the following operation of the switch.

It should be understood that the software for one specific applicationof the invention that follows this specification is for purposes ofexample. The software may take many other forms in other applications ofthe invention.

Switches which have a flat panel display in the switch cap may be usedin a variety of other devices. Referring to FIG. 18A for anotherexample, automobile radios 128 typically have a row of programmable pushbutton switches 129 which can be used to select specific broadcastingstations. Recent car radios 128 are also often equipped with amicroprocessor controlled flat panel display 131 which displaysinformation concerning the station to which the radio is tuned, such asthe frequency at which the station broadcasts and whether it is AM orFM. This does not in and of itself indicate which switch 129 is to beoperated to select a particular station. This information can beconveyed to the operator of the radio 128 by providing station selectorswitches 129 which have flat panel displays 132 at the front faces ofthe switch caps 133.

The internal construction of the switches 129 may, if desired, besimilar to that of the switch 88a hereinbefore described with referenceto FIG. 15. Referring now to FIG. 19, the radio 128 may be of knowndesign except as herein described. Thus the radio 128 may include aconventional antenna 134 coupled to an RF stage 136 which is itselfcoupled to an output stage 137 and speaker 138 through a microprocessor139 controlled tuning interface 141. The microprocessor controlledtuning interface 141 may, for example, be of the Phillips TEA1600 type.

Each station selector switch 129 is connected to a separate one of thestation selection inputs 142 of microprocessor 139 and depression of anyof the switches momentarily grounds the associated input to initiate astation change in the known manner. Referring again to FIG. 18A, theparticular station which is to be selected in response to operation of aparticular selector switch 129 may be programmed into the microprocessorby the user of the radio in the known manner. This is accomplished bytuning the radio to the desired frequency with the dial controls 143,pushing a store button 144 and then momentarily depressing the selectorswitch 129 that is to be programmed to select that station.

Referring again to FIG. 19, microprocessor 139 controls a flat paneldisplay controller 143 which causes the station information display 131to display the frequency of the selected station and the letters AM orFM also in the known manner.

For purposes of the present invention, a read only memory 144,preferably of the erasable, user-programmable (EPROM) type, provides themicroprocessor 139 with an identification of the station thatcorresponds to each AM and FM frequency which is broadcast in thegeographical area where the radio will normally be used. This enablesdisplay of the call letters of the selected station at the stationinformation display 131 in addition to the conventional display ofstation frequency and further enables a display at the face of eachselector switch 129 of the call letters of the station which the switchis programmed to select. As shown in FIG. 18B, the display at the faceof the selector switches 129 changes if the switches are reprogrammedand, as shown in FIG. 18C, the displays change to indicate the differentcall letters of the programmed stations when the radio 128 is switchedfrom AM operation to FM operation or vice versa by operation of theAM/FM selector buttons 146.

Optionally, microprocessor 139 can be programmed to enable any of avariety of additional interactions with the user of the radio 128. Theexisting controls such as station selector switches 129, dial control143, store button 143 and others can be provided with alternatefunctions when combinations of such controls are actuated in conjunctionwith each other. The system may, for example, be caused to display acategorization of local stations by type of broadcast content at theinformation display 131. For example, shifting of the dial control 143to successive predetermined frequency settings while another control isalso actuated can be caused to initiate a listing of news stations atdisplay 131 followed by a listing of sports stations, followed by adisplay of classical music stations, followed by displays of still othercategories. As another example, the radio 128 can be provided with aconnector for plugging in a computer of the lap top or notebook typewhich can allow the user to store notes, reminders, route directions orother data for subsequent display at the display 131.

Previously described embodiments of the invention which have a manuallymanipulated control member superimposed on the face of a flat paneldisplay, such as the controls of FIGS. 1 and 2 for example, enable aclose association of displayed graphics with the control member bysituating only the control member at the face of the screen. Othercomponents of the control are behind the screen and are mechanicallycoupled to the control member through openings in the screen. If theother components were also at the face of the screen the movable controlmember would in many cases be spaced outward from the displayed graphicsin a manner which would make precise adjustments of the control memberdifficult and/or make it more difficult to recognize the particularcontrol that particular graphics relate to. In some instances suchoutward spacing of the movable control member does not create suchproblems and it is not necessary to provide passages through the screen.For example, with reference to FIG. 20, a two way, two position toggleswitch 147 that is not in close proximity to another control may be ofconventional construction and simply be adhered to the face of the flatpanel display screen 148. The terminals 149 of the switch 147 may beconnected to the device which the switch controls through transparentconductors 151 which extend along the face of screen 148 to an edgeconnector 152 of the previously described kind.

Referring jointly to FIGS. 21 and 22, movements of a manuallymanipulated control member 153 at the screen 154 of a flat panel display156 can be detected by sensing means 157 located behind the screen whichdoes not require open passages through the screen.

The movable control member 153 of this example is of the turnable knobtype and has a lower end which seats in an annular switch base 158 thatis adhered to the face of screen 154. A small flange 159 on the knob 153snap engages with a conforming lip 161 of the switch base 158. Althoughit is not essential, a shaft 162 may extend from the switch base 158into knob 153, along the axis of rotation of the knob, to impart thekinesthetic feel of a conventional shaft mounted knob to the mechanism.

Sensing means 157 is of an optical form in this example and includes atube 163 disposed at the opposite side of screen 154 from knob 153, thetube being directed at a region of the knob that is offset from the axisof rotation of the knob. The end of tube 163 contains a light source164, which may be a laser diode for example. A lens 166 at the other endof tube 163 focuses light from source 164 at a circular coding disk 167that is secured to the undersurface of knob 153 that faces screen 154.As best seen in FIG. 23, coding disk 167 has opaque areas 168 thatalternate with transparent areas 169. The areas 168 and 169 in thisexample are at alternating sectors of disk 167 and are of equaldimensions and are spaced at equal angular intervals around the axis ofrotation of the disk. For clarity of illustration, the coding disk 167is shown in FIG. 23 with fewer of the areas 168 and 169 than willtypically be present.

Referring again to FIGS. 21 and 22, the coding disk 167 seats in acircular recess 171 in knob 153 and a circular, centrally aperturedmirror 172 is secured in the recess behind the disk to reflect lightwhich passes through the coding disk back into tube 163. The tube 163has a branch 173 which extends at right angles to the light path betweensource 164 and mirror 172 and which contains a light detector 174 whichmay be a photodiode for example.

Owing to the alternating opaque and transparent areas 168 and 169 oncoding disk 167, turning of knob 153 causes mirror 172 to return pulsesof light to tube 163, the number of such pulses which are returned beingindicative of the amount of turning of the knob which has occurred. Abeam splitter or half silvered mirror 176 is disposed in tube 163 at theentrance to branch 173 and is oriented to reflect a portion of the lightwhich is returned by mirror 172 towards detector 174. Thus duringturning of knob 153, the detector 174 generates a series of electricalpulses 177 the number of such pulses being indicative of the amount ofmovement of the knob that has taken place. The electrical circuit 178 towhich detector 174 is connected may take a variety of forms depending onthe type of apparatus which knob 153 controls but will in generalinclude a pulse counter 179 which tracks the movements of knob 153 bycounting pulses 177 and thus produces a signal that is indicative of theangular setting of the knob at any given time.

Tracking of the position of knob 153 in this manner requires that thepulse counter 179 be able to sense the direction of the angularmovements of knob 153 in order to add or subtract incoming counts fromthe accumulated total depending on the direction of knob motion. Forthis purpose, a light filter disk 181 is disposed against coding disk167 and secured thereto to turn with the coding disk. As best seen inFIG. 24, filter disk 181 has a light transmissivity that is highest atone particular radius and which progressively decreases in the angulardirection around the disk. Thus, with reference again to FIGS. 21 and22, the amount of light that is returned to tube 163 by mirror 172 isdependent on the angular orientation of the knob 153 and filter disk181. Consequently, the height or amplitude of electrical pulses 177progressively changes as knob 153 is turned and will increase ordecrease depending on the direction of knob rotation. This enables acomparator portion 182 of the circuit 178 to compare the amplitude ofeach incoming pulse 177 with the amplitude of the preceding pulse andthereby determine if counter 179 is to add or subtract the current pulsecount from the accumulated total count. The pulse counter 179 andcomparator 182 need not necessarily be of the analog form as thefunctions of these components can be performed by a microprocessor orcomputer.

FIG. 25 depicts an alternate form of filter disk 181a that can serve thesame purpose as the disk 181 of FIG. 24. The disk 181a of FIG. 25 has anopaque zone 183 which extends around the disk adjacent a transparentzone 184 which also extends the disk. Opaque zone 183 is of maximumwidth and transparent zone 184 is of minimum width at one particularlocation on the disk 181a. The opaque zone 183 becomes progressivelynarrower and transparent zone 184 becomes progressively wider atsuccessive locations around the disk. Disk 181a can be substituted forthe filter disk 181 of FIGS. 21 and 22 if lens 166 is removed or if thedisk 181 located away from the focal point of the lens.

Optionally, the sensitivity of sensing means 157 can be increased bysituating another disk 186 between filter disk 181 and tube 163, thedisk 186 being stationary and being adhered to the floor of switch base158. Disk 186 is opaque except at a sector shaped area 187 of the diskwhich is located at the passage 188 in the switch base 158 through whichthe light from source 164 travel through the switch base en route tomirror 172. Disk 186 suppresses scattered or diffracted light whichmight otherwise reach detector 174.

FIG. 26 depicts an alternate form of coding disk 167a which makes itunnecessary to use the previously described filter disk for the purposeof sensing the direction of rotation of the knob. The alternate codingdisk 167a again has sector shaped opaque areas 189 alternating withsector shaped transparent areas 191 but such areas are not of uniformwidth as in the previous case. The opaque area 189 at one particularlocation on the disk 167a is of maximum width and such areas 189 becomeof progressively diminishing width at successive angular locationsaround the disk while the transparent areas 191 become of progressivelygreater width. Thus the amount of light that is transmitted though thedisk 167a, when it is substituted for the coding disk 167 of FIGS. 21and 22, is dependent on the angular orientation of the disk.Consequently, the amplitudes of the detector output pulses 177 vary inresponse to turning of knob 153 in the manner previously described.

Light from tube 163 is transmitted through the flat panel display screen154 as the components of the screen including the x and y bus barconductors in this example are transparent. It is not essential in allinstances that the bus bar conductors be transparent in instances wherethe conductors are spaced apart sufficiently to enable lighttransmission between the conductors. If desired, with reference to FIG.27, light transmission through the screen 154 can be enhanced byproviding thin edge sealed openings 192 of the previously described kindin the screen at the locations where the light passes through thescreen.

Referring again to FIGS. 21 and 22, the pulse count stored in counter179 is essentially a digital or analog signal encoding the angularposition of knob 153 and thus may be transmitted to any of diversedifferent systems that require input of such information, the previouslydescribed computer control system of FIG. 16 being one example.

The light source 164 of the embodiment of FIGS. 21 and 22 producesvisible light. Sources 164 which produce radiant energy of otherwavelengths, such as infrared or ultraviolet for example, can also beused along with a detector 174 that responds to the particular type ofradiant energy. The coding disk 167 may be provided with different formsof marking to identify the successive angular orientations of the disk,such as bar code markings for example, and the coding disk may beeliminated if the markings which it carries are imprinted on mirror 172.

Sensing means 157 need not necessarily be of a type which operates byoptical coupling. FIGS. 28 and 29 depict an embodiment having sensingmeans 157a which detects turning of a knob 153a from a location behindthe display screen 154a by magnetic coupling. As in the previouslydescribed embodiment, knob 153a may be snap engaged in a switch base158a which is itself adhered to the face of the display screen 154a. Acircular plastic disk 193 is adhered to the surface of knob 153a whichfaces the screen 154a and a small permanent magnet 195 is embedded inthe disk at one particular location around the periphery of the disk. Arotary encoder 194 of the hereinbefore discussed known form is situatedbehind the screen 154a and has a rotatable input shaft 196 which extendstowards the screen along the axis of rotation of knob 153a. Anotherplastic disk 197 is secured to the end of input shaft 196 adjacent theback surface of the screen and has a small piece of ferromagnetic ormagnetizable material 197a embedded in its rim at one location aroundthe periphery of the disk.

The magnetic attraction of material 197a by magnet 195 causes the inputshaft 196 of rotary encoder 194 to track the turning of knob 153a andthus the encoder shaft maintains the same angular orientation as theknob. Encoder 194 produces a multi-bit signal at output terminals 198 inthe known manner that encodes the angular orientation of input shaft 196and which is equivalent to the output signal of the previously describedembodiment.

The apparatus of FIGS. 28 and 29 remains operable if the ferromagneticmaterial 197a is replaced with a another magnet. Magnet 195 and theferromagnetic material 197 may be larger in instances where a strongermagnetic coupling is needed in order to turn encoder shaft 196 and themagnet may be embedded in the body of knob 153 rather than beingembedded in a separate disk 193. The magnet 195 may be carried by theencoder disk 197 while the ferromagnetic material is embedded in theknob disk 193. Permanent magnet 195 may be replaced with anelectromagnet although this requires additional wiring and the use ofsliding contacts in some instances.

FIGS. 30 and 31 depict optical sensing of the setting of a push-buttontype of switch 199 from a location behind a flat panel display screen201 when the switch is disposed at the face of the screen.

Switch 199 has a switch base 200, which is rectangular in thisparticular example, that is adhered to the face of the flat paneldisplay screen 201 and which forms a chamber 202 into which the lowerend of a conforming switch button or key 203 is fitted. A rounded flange204 at the base of button 203 snap engages with a conforming lip 206 ofbase 201 to retain the button in engagement with the base. Leaf springs207 which extend along opposite sides of chamber 202 each have one fixedend 208 secured to the floor of the chamber and a free end 209 whichbears against the base of button 203 and urges the button away from thefloor of chamber 202. Button 203 may be manually depressed against theforce of springs 207 to travel the button further into chamber 202 to aposition at which the switch 199 is in the actuated condition.

The switch 199 of this particular example is of the latching typewherein the switch button 203 remains in a partially depressedcondition, which is the on or actuated condition of the switch,following an initial depression of the button by the operator's finger.The button 203 returns to its uppermost or off position following thesubsequent depression of the button. Latching means 211 for this purposemay take a variety of forms. In the present example, switch base 200 hasa hollow, rectangular latch pin support 212 which extends up into achamber 213 in switch button 203. An integral portion 214 of switchbutton 203 extends downward into the interior of pin support 212. Acurved, resilient latch pin 216 has an end which is secured to support212. The pin 216 extends outward from support 212 and then turns backand extends through a slot 217 in the support and into a pin trackgroove 218 in portion 214 of the switch button.

FIG. 33 depicts the configuration of groove 218 that produces the abovedescribed latching action. The groove 218 forms a continuous heartshaped loop with a right hand lobe 219 and a left hand lobe 221 asviewed in FIG. 33. When the switch button 203 is at its uppermost or offposition the latch pin 216 is seated at the bottom of the loop andprevents further upward travel of the button. The button 203 seats atthe top of the right hand lobe 219 of groove 218 when the button isdepressed for the first time thereby preventing further depression ofthe button. Upon release of the button 203 by the operator, the pin doesnot return to the original position as the resiliency of the pin biasesthe pin to move in a leftward direction. Instead, the pin seats at theuppermost junction of lobes 219 and 221 and thereby latches the switchbutton 203 at a partially depressed state which is the on condition ofthe switch. The next depression of button 203 causes the pin 216 to seatmomentarily against the top of the left hand lobe 221. The pin 216 doesnot return to its latching position when the operator releases thebutton 203 as the groove 218 has a step 222 between that position andthe top of the left hand lobe, the groove being deepest at the left sideof the step. Consequently, the pin is guided along the left hand lobe221 back to the lowermost junction of the two lobes 219 and 221 at whichthe button 203 is at its uppermost or off position.

Referring again to FIGS. 30 and 31, the setting of switch 199 isdetected by sensing means 223 situated behind the display panel screen201 which means includes a light source 164, light detector 174 and beamsplitter 176 disposed in a branched tube 163 in the manner previouslydescribed with respect to the embodiment of FIG. 21. Referring again toFIGS. 30 and 31, the tube 163 is positioned to direct the light fromsource 164 through screen 201 and an opening 224 in switch base 200 andon into a passage 226 which extends upward through switch button 203 atthe center of the button. A light diffusing lens 227 is embedded inbutton 203 at the top of passage 226.

The light passage 226 is intersected by a slot 228 in switch button 203in which a slidable, flexible, resilient light interceptor leaf 229 isdisposed. Leaf 229 has a light reflecting undersurface 231 which extendsacross passage 226 when the switch button 203 is at its elevated or offposition as depicted in FIGS. 30 and 31. Thus light from source 164 isreflected back to beam splitter 176 when the button 203 is at the offposition. Beam splitter 176 reflects a portion of such light towardsdetector 174. This causes the output signal 232 of the detector 174 tobe in a high state when button 203 is at its undepressed or offposition.

The end of leaf 229 which is remote from light passage 226 extends intoanother chamber 233 within switch button 203 and is fastened to the topof a post 234 which extends downward through a passage 236 in the buttonand which has a lower end that abuts the floor of switch base chamber202. A helical compression spring 237 in chamber 233 bears against theupper end of post 234 and holds the post in abutment with the floor ofswitch base chamber 202.

Referring now to FIG. 32, depression of the switch button 203 to the onposition of the switch causes post 234 to pull leaf 229 out of lightpassage 226. The output signal from light detector 174 goes low,signaling that the switch 199 is in the on condition, as light fromsource 164 is no longer being reflected back to the detector. The lightis now emitted from the switch button 203 at lens 227 thereby providinga visual indication that the switch 199 is on. Spring 237 urges leaf 229back into light passage 226, to the position shown in FIG. 30, when theswitch button is restored to its uppermost or off position.

The output signal 232 of detector 174 can be used to control diversetypes of electrical system 238. The signal can, for example, betransmitted through an inverter and an amplifier and then be used tocontrol a relay which supplies operating power to an electricalappliance.

FIGS. 34 and 35 depict a modified mechanism for traveling the lightintercepting leaf 229a in a pushbutton switch assembly 199a that canotherwise be similar to the switch assembly of FIGS. 30 to 32. Referringto FIGS. 34 and 37 the leaf 229a is rigid in this case and is providedwith a linear rack of gear teeth 239. Teeth 239 are engaged by a piniongear 241 within a chamber 233a of the switch button 203a, the axle shaft242 of the gear being in orthogonal relationship with leaf 229a.

Gear 241 also engages another linear rack of gear teeth 243 which are ona post 244 that extends up into chamber 233a from the switch base 200a.Thus depression of the switch button 203a causes gear 241 to turn and tothereby withdraw leaf 229a from the light passage 226a. Release of theswitch button 203a causes the gear 241 to turn in an opposite directionand thereby travel leaf 229a back to the position at which it extendsacross the light passage 226a.

Switch buttons or caps of the kind found in the embodiments of FIGS. 30to 35, such as the button 203a of FIG. 34, can have display screenembedded in the switch button itself in the manner previously describedwith reference to the embodiments of FIGS. 13 to 15 although thisrequires that an edge sealed opening of the above described kind beprovided in the underlying display screen 201a to enable electricalconnections to the switch button screen.

Movement of a slidable control knob or the like can also be opticallysensed from a location behind a flat panel display screen withoutrequiring that there be openings in the screen. For example, withreference to FIGS. 36 and 37, the manually slidable cap 246 of a fader247 of the general type which has been previously described can besupported by a thin elongated linear track 248 which is adhered to theface of the display panel screen 249 that displays a decibel scaleand/or other graphics. The track 248 in this example has a hollowinterior and an elongated slot 251 which extends along the outer face ofthe track. The cap 246 is secured to a stem 252 which extends into slot251 and which has a base portion 253 that conforms in height and widthwith the hollow interior of the slot.

The track 248 contains a pair of rotatable pulleys 254 and 256 which aresituated at opposites ends of the track and which have axes of rotationthat extend at right angles to the screen 249. A flexible belt 257 isengaged on the pulleys 245 and 246 and is fastened to the cap stem baseportion 253 at one side of the base portion. Belt 257 passes freelythrough a passage 258 at the other side of the base portion 253. Thusthe belt 257 turns pulleys 254 and 256 when cap 246 is slid from onelocation along track 248 to another and the amount and rate of pulleyrotation is proportional the distance and speed of the travel of thecap.

Referring now to FIG. 38, one of the pulleys, pulley 254 in thisexample, has a circular recess 259 which is centered on the axis ofrotation of the pulley and which faces screen 249. A circular mirrordisk 261 is disposed in recess 259 behind a coding disk 262 which disksare in coaxial relationship with pulley 254 and turn with the pulley.Coding disk 262 may carry bar coding or be of one of the formspreviously described with reference to the embodiment of FIGS. 21 to 26such as the disk 167a of FIG. 26 which has alternating transparent andopaque sectors of progressively changing width.

Sensing means 263 are situated behind the flat panel display screen 249within a branched tubulation 264 which has a first leg containing alight source 266 and lens 267 which focuses the light on coding disk 262through an opening 268 in the floor of track 248. The other leg oftubulation 264 is angled relative to the first leg in order to receivelight that has passed through the coding disk 262 and which has beenreflected back into the tubulation 264 by mirror disk 261. The other legcontains the light detector 269 and a lens 271 that focuses thereflected light into the detector. Detector 262 produces sequences ofoutput pulses in response to turning of the coding disk which may becounted, in the manner previously described with respect to theembodiment of FIGS. 21 to 26, to provide a signal that is indicative ofthe movements and current setting of the fader cap 246 which signal maybe used to control amplitude in a sound processor for example.

The presence of the track 248 causes the cap 246 to protrude from screen249 for a distance that is greater than the protrusion of the cap of aconventional fader from the surface that underlies the cap. This can bedistracting to many operators of the fader. To counteract this effect, atransparent plate 270 is disposed against the face of screen 249 and hasan opening conforming with the shape of track 248 in which the track issituated. Plate 270 has a thickness corresponding to the thickness ofthe track 248 and thus functions to create the kinesthetic feel of aconventional fader.

The sensing means may take other forms. FIGS. 39, and 40, for example,depict portions of a fader 272 which also has an elongated hollow track273 which is adhered to the face of a display screen 274 and a cap 276which is manually slidable along the track. As in the previous instance,cap 276 is supported by a stem 277 that extends into an elongated slotat the face of the track 273 and which has a broader base portion 278that conforms with the interior of the track.

The pulleys 279 and 281 which are within the opposite ends of track 273are in this instance oriented to have axes of rotation that are parallelto the screen 274 and at right angles to the track. A belt 282 isengaged on pulleys 279 and 289 within the track 273. The upper portionsof belt 282 are fastened to the base portion 278 of cap stem 277 whilethe lower portion of the belt travels freely through a notch 283 in thebase portion. Thus sliding movement of the fader cap 276 travelssuccessive portions of belt 282 along the floor of track 273.

The outer surface of belt 282 has markings, such as bar codes 284, thatenable an optical reader or bar code scanner 286 to track movement ofthe belt 282 as the code markings travel past a small window 287 in thefloor of track 273, the scanner being behind the display screen 274.

A transparent plate 288 is disposed against the surface of the screen274 and has a thickness similar to that of the track 273 so that theprotrusion of the fader cap 276 from the underlying surface will be ofconventional proportions.

Transparent plates, such as plate 288, may be used for a similar purposein faders or the like which have openings that extend through thedisplay screen such as in the previously described embodiment of FIGS. 9to 11. In such cases, the routing of transparent bus bar conductors 54faround the opening 77 as depicted in FIGS. 11A and 11B may take place atthe surface of the transparent plate rather than at the surface of theunderlying display screen.

Referring again to FIGS. 39 and 40, sensing of the movement of a slidingfader cap 276 may be effected by means other than the optical sensingwhich has been described above. For example, with reference to FIG. 41,the optical reader may be replaced with a fader 289 which extends inparallel relationship with track 273 behind screen 274. The fader 289may be of conventional design except insofar as the key cap of the faderis replaced with a magnet 291. A second magnet 292 is secured to thebelt 282 within track 273. The embodiment of FIG. 41 may otherwise besimilar to the embodiment of FIGS. 39 and 40.

Referring again to FIG. 41, the mutual attraction of magnets 291 and 292causes the key cap stem 293 of fader 289 to track movements of the belt282. Thus the fader 289 is in effect operated in the same manner that itwould be directly operated by a person grasping a key cap on stem 293.

Referring now to FIGS. 42 and 43, a belt and pulley arrangement of theabove described kind can also be used to effect mechanical control of arotary encoder 294 or the like that is situated behind the displayscreen 296. In this example, an elongated track 297 is adhered to theface of the display screen 296 in the previously described manner andhas an elongated slot through which a slidable key stem 297 extends. Asbest seen in FIG. 44, stem 297 has an enlarged base portion 298 whichconforms with the interior of track 297 and a fader key cap 299 issecured to the portion of the stem that protrudes from the track.

Referring again to FIGS. 42 and 43, one of a pair of pulleys 301 and 302is situated within track 297 at each end of the track and the pulleyshave axes of rotation that are parallel to screen 296 and at rightangles to the track. An additional pair of pulleys 303 and 304 aresecured to the circuit board 306 of the flat panel display by brackets307 and have axes of rotation that are parallel to the axes of rotationof the first pair of pulleys 301 and 302. The rotary encoder 294, whichhas an input shaft 308, is also secured to circuit board 306 and issituated between pulleys 303 and 304.

A pair of thin edge sealed openings 309 of the previously described kindextend through the screen 296 and continue on through the light diffuser311, back lighting diode array 312 and the circuit board 306. One suchopening 309 extends between pulleys 301 and 303 and the other extendsbetween pulleys 302 and 304. An encoder drive cable 313 has oppositeends fastened to the base portion 298 of key cap stem 297. Referringjointly to FIGS. 42 and 45, cable 313 extends from stem portion 298around pulley 301, through the adjacent passage 309, around pulleys 303and 304, through the adjacent passage 309, around pulley 302 and back tokey cap stem portion 298. The portion of cable 313 which extends betweenthe lowermost pulleys 303 and 304 is looped around another pulley 314which is secured to the input shaft 308 of encoder 294. Thus manualmovement of the key cap 299 turns the encoder input shaft 308 whichresponds in the previously described manner by producing output signalswhich encode the location and movements of the key cap.

The embodiment of FIGS. 42 to 45 is particularly suited for use in amotorized or automated fader system of the known kind in which initiallymanual motions of the fader key 299 are tracked and encoded into analogor digital signals which are stored to enable automatic repitition ofthe movements by drive motor means. The fader drive shaft of such asystem can easily be coupled to one of the pulleys 303 or 304 to enablethe automatic repetition of fader key movements.

While the invention has been disclosed with respect to certain specificembodiments for purposes of example, many other modifications andvariations are possible and it is not intended to limit the inventionexcept as defined in the following claims.

I claim:
 1. In apparatus for enabling manual control of electricalequipment which apparatus has a plurality of operator actuatedcomponents each having a component housing and an actuator which extendsfrom the housing and which can be moved from a first position to atleast one other position to alter operation of said equipment, theimprovement comprising:a control panel formed at least in part by a flatpanel display having a screen with an image area at which visible imagescan be displayed, said screen having a first array of parallel busbarstherein which extend within said image area of said screen and whichextend in orthogonal relationship with busbars of a second array ofparallel busbars within said display screen and which enable activationof different combinations of image pixels at different times, saidscreen having a plurality of spaced apart openings which extend throughsaid screen and which are situated in said image area thereof, saidoperator actuated components being disposed at said image area of saidscreen with said housings of said components being behind said screenand wherein said actuators of said components extend through saidopenings in said image area of said screen, and control means forgenerating visible images at said image area of said screen which imagesconvey information pertaining to operation of said components.
 2. Theapparatus of claim 1 wherein said control means energizes said busbarsin a variable manner to enable changing of the visible image associatedwith a control component when the component is used to control differentoperations of said equipment.